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DEVELOPMENT  OF  THE  ENLISTMENT  SCREENING  TEST -EST  FORMS  5 AND  6 


I.  INTRODUCTION 


It  has  been  estimated  that  the  total  cost  to  the  Air  Force  for  transportation,  nteals,  and  lodging  for 
individuals  taking  the  Amtd  Services  Vocational  Aptitude  Battery  (ASVAB)  was  $2.6  million  in  FY  74  and 
was  estimated  to  be  S2.9  million  in  FY  75.  It  was  believed  that  a significant  reduction  in  enlistment 
processing  costs  could  be  achieved  through  the  use  of  an  enlistment  screening  test  that  would  identify  those 
applicants  highly  likely  to  meet  current  ASVAB  qualifying  standards. 

The  Enlistment  Screening  Test  (EST)  was  developed  to  serve  sucn  a purpose,  with  provisions  for  the 
test  to  be  administered  and  scored  at  the  local  recruiting  office.  In  this  manner,  the  screening  test  would 
promptly  eliminate  from  further  consideration  those  enlistment  applicants  most  likely  not  to  achieve 
qualifying  ASVAB  scores  at  the  centralized  testing  point. 


II.  DEVELOPMENT  Ol  THE  TEST 

From  the  existing  Air  Force  Human  Resources  Laboratory  (AFHRL)  test  item  pool,  two  forms  of  the 
experimental  screening  test  were  created.  Each  form  contained  90  items;  30  in  each  of  the  content  areas 
(Word  Knowledge.  Arithmetic  Reasoning,  and  Space  Perception).  Items  included  in  the  experimental  forms 
were  selected  on  the  basis  of  falling  within  a difficulty  range  of  .45  to  .90  with  each  item  demonstrating 
high  discriminating  ability. 

The  experimental  forms  were  sent  to  each  of  the  five  Recruiting  Groups,  who  distributed  them  to  a 
nationally  representative  sample  of  recruiting  offices.  In  an  effort  to  obtain  an  unrestricted  range  of  abilities 
as  measured  by  subsequent  performance  on  ASVAB-3,  pre-screening  of  prospective  applicants  was  not 
conducted.  From  these  experimental  administrations,  item  analysis  data  was  available  for  selecting  the  45 
items  (15  from  each  content  area)  to  be  included  in  each  final  version  of  the  EST. 

Items  to  be  included  in  the  final  version  were  selected  to  provide  a test  maximally  discriminative 
around  an  AFQT  of  31  and  a 170  sum  of  the  four  Air  Force  aptitude  indexes  (Mechanical,  Administrative, 
General,  and  Electronics).  The  approach  used  in  the  selection  of  items  involved  the  “item  characteristic 
curve”  as  introduc’d  by  Tucker  (1946).  Tire  curve  is  essentially  a fitted  line  through  points  obtained  by 
plotting  the  proportion  of  correct  respondees  to  a specific  item  against  an  external  criterion  score,  which  in 
this  study  was  the  ASVAB-3  AFQT  score  expressed  in  standardized  “z”  scores.  With  a normal  ogive  fitted 
through  the  points,  the  two  parameters  are  X50  (the  point  at  which  5 O'?  of  the  respondees  passed  the  item) 
and  (3,  which  indicates  the  discrimination  power  of  the  item.  With  this  information,  selected  items  fell  with 
an  X5  o range  of  approximately  1.00  and  + .45  with  the  (?  value  being  as  high  as  possible. 


III.  RESULTS  AND  DlSt  l SSION 


Each  final  form  of  the  EST  contains  45  items  (15  items  in  each  of  the  three  content  areas)  and 
requires  up  to  45  minutes  for  administration.  This  liberal  time  limit  is  designed  to  permit  the  slower 
applicant  to  finish.  Testing  is  terminated  when  the  applicant  completes  the  45  items.  The  test  is  scored  by 
the  recruiter,  immediately  providing  information  as  to  whether  further  processing  is  warranted. 

Table  1 presents  a summary  of  statistical  information  on  EST-5  and  EST-6.  The  data  suggests  the  two 
forms  are  statistically  parallel,  with  each  demonstrating  a high,  positive  correlation  with  Armed  Forces 
Qualification  Test  (AFQT)  and  the  Aptitude  Index  sum  derived  from  ASVAB-3. 

Tables  A1  and  A2  of  the  appendix  present  the  cumulative  percentages,  within  score  percentages,  and 
frequencies  of  qualification  and  disqualification  based  upon  an  AFQT  of  31  and  an  Aptitude  Index  sum  of 


5 


170.  Using  a cutting  score  of  IS,  the  data  reflects  that,  for  Form  5,  31  percent  of  those  who  subsequently 
failed  to  qualify  for  enlistment  on  the  basis  of  either  criterion  could  have  been  identified,  while  rejecting 
only  four  percent  of  those  who  ultimately  qualified.  Using  the  same  cutting  score  for  Form  6,  34%  of 
subsequent  failures  would  have  been  detected  while  only  six  percent  of  those  (who  subsequently  achieved 
qualifying  ASVAB  scores)  would  have  been  eliminated  from  further  processing. 


IV.  CONCLUSIONS 

While  significant  numbers  of  enlistment  applicants  would  continue  to  be  sent  to  a centralized  testing 
point  and  fail  to  meet  ASVAB  qualifying  standards,  the  use  of  the  Enlistment  Screening  Test  could  be  of 
benefit  in  increasing  the  proportion  of  successes.  Cutting  scores  can  be  varied  according  to  service  needs 
but,  even  with  the  cutting  score  presented  in  this  report,  substantial  savings  in  transportation,  feeding,  and 
lodging  costs  can  be  realized. 


Table  l.  Summary  Statistics  (EST-5  and  EST -6) 


Statistical  Summaries 

Form  5 

Form  6 

Sample  Size  (N) 

535 

499 

Mean  (X) 

27.94 

28.55 

Standard  Deviation  (SD) 

10.16 

10.43 

EST  vs  MAGE  (correlation) 

.76 

.74 

EST  vs  AFQT  (correlation) 

.71 

.72 

Coefficient  Alpha 

.92 

.93 

Standard  Error  of  Measurement  (S.E.M.) 

2.87 

2.84 

Mean  (ASVAB-3  AFQT) 

44.19 

45.28 

Standard  Deviation  (ASVAB-3  AFQT) 

12.69 

12.78 

Mean  Standardized  Item  Difficulty 

.50 

.51 

REFERENCES 
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Table  Al.  Cumulative  Percentages,  Within  Score  Percentages,  and 
Frequencies  of  Qualification  and  Disqualification 
Based  Upon  AFQT  of  31  and  MAGE  of  170 


Not  Qualified 


Within  Score 

Within 

Cumulative 

Within  Score 

Within 

Cumulative 

Frequency 

Score  % 

% 

Frequency 

Score  % 

% 

0 

0 

0 

0 

2 

15 

0 

0 

0 

0 

0 

0 

0 

0 

1 

5 

1 

6 

1 

6 

0 

0 

2 

1 1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 
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18 

1 
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41 

6 

43 

4 

33 

1 

61 
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0 
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100 
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0 
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100 
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100 

43 
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100 
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100 
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99 

12 

100 

38 
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99 

12 

100 

37 

0 
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99 
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100 

36 

0 

0 

99 

11 

100 

35 

1 
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99 

18 

95 

34 

1 

7 

98 

13 

93 

33 

5 

27 

98 

13 

73 

32 

1 

9 

93 

10 

91 

31 

0 

0 

93 

17 

100 

30 

2 

IS 

93 

11 

85 

29 

2 

20 

92 

8 

80 
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5 

23 
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57 
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71 
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63 
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